Towards human-compatible autonomous car: A study of non-verbal Turing test in automated driving with affective transition modelling

Autonomous cars are indispensable when humans go further down the hands-free route. Although existing literature highlights that the acceptance of the autonomous car will increase if it drives in a human-like manner, sparse research offers the naturalistic experience from a passenger's seat perspective to examine the human likeness of current autonomous cars. The present study tested whether the AI driver could create a human-like ride experience for passengers based on 69 participants' feedback in a real-road scenario. We designed a ride experience-based version of the non-verbal Turing test for automated driving. Participants rode in autonomous cars (driven by either human or AI drivers) as a passenger and judged whether the driver was human or AI. The AI driver failed to pass our test because passengers detected the AI driver above chance. In contrast, when the human driver drove the car, the passengers' judgement was around chance. We further investigated how human passengers ascribe humanness in our test. Based on Lewin's field theory, we advanced a computational model combining signal detection theory with pre-trained language models to predict passengers' humanness rating behaviour. We employed affective transition between pre-study baseline emotions and corresponding post-stage emotions as the signal strength of our model. Results showed that the passengers' ascription of humanness would increase with the greater affective transition. Our study suggested an important role of affective transition in passengers' ascription of humanness, which might become a future direction for autonomous driving.Comment: 16 pages, 9 figures, 3 table

Prefrontal Cortex and Somatosensory Cortex in Tactile Crossmodal Association: An Independent Component Analysis of ERP Recordings

Our previous studies on scalp-recorded event-related potentials (ERPs) showed that somatosensory N140 evoked by a tactile vibration in working memory tasks was enhanced when human subjects expected a coming visual stimulus that had been paired with the tactile stimulus. The results suggested that such enhancement represented the cortical activities involved in tactile-visual crossmodal association. In the present study, we further hypothesized that the enhancement represented the neural activities in somatosensory and frontal cortices in the crossmodal association. By applying independent component analysis (ICA) to the ERP data, we found independent components (ICs) located in the medial prefrontal cortex (around the anterior cingulate cortex, ACC) and the primary somatosensory cortex (SI). The activity represented by the IC in SI cortex showed enhancement in expectation of the visual stimulus. Such differential activity thus suggested the participation of SI cortex in the task-related crossmodal association. Further, the coherence analysis and the Granger causality spectral analysis of the ICs showed that SI cortex appeared to cooperate with ACC in attention and perception of the tactile stimulus in crossmodal association. The results of our study support with new evidence an important idea in cortical neurophysiology: higher cognitive operations develop from the modality-specific sensory cortices (in the present study, SI cortex) that are involved in sensation and perception of various stimuli

Neural Correlates of Feedback Processing in Visuo-Tactile Crossmodal Paired-Associate Learning

Previous studies have examined the neural correlates for crossmodal paired-associate (PA) memory and the temporal dynamics of its formation. However, the neural dynamics for feedback processing of crossmodal PA learning remain unclear. To examine this process, we recorded event-related scalp electrical potentials for PA learning of unimodal visual-visual pairs and crossmodal visual-tactile pairs when participants performed unimodal and crossmodal tasks. We examined event-related potentials (ERPs) after the onset of feedback in the tasks for three effects: feedback type (positive feedback vs. negative feedback), learning (as the learning progressed) and the task modality (crossmodal vs. unimodal). The results were as follows: (1) feedback type: the amplitude of P300 decreased with incorrect trials and the P400/N400 complex was only present in incorrect trials; (2) learning: progressive positive voltage shifts in frontal recording sites and negative voltage shifts in central and posterior recording sites were identified as learning proceeded; and (3) task modality: compared with the unimodal PA learning task, positive voltage shifts in frontal sites and negative voltage shifts in posterior sites were found in the crossmodal PA learning task. To sum up, these results shed light on cortical excitability related to feedback processing of crossmodal PA learning

Sequential Neural Processes in Abacus Mental Addition: An EEG and fMRI Case Study

Abacus experts are able to mentally calculate multi-digit numbers rapidly. Some behavioral and neuroimaging studies have suggested a visuospatial and visuomotor strategy during abacus mental calculation. However, no study up to now has attempted to dissociate temporally the visuospatial neural process from the visuomotor neural process during abacus mental calculation. In the present study, an abacus expert performed the mental addition tasks (8-digit and 4-digit addends presented in visual or auditory modes) swiftly and accurately. The 100% correct rates in this expert’s task performance were significantly higher than those of ordinary subjects performing 1-digit and 2-digit addition tasks. ERPs, EEG source localizations, and fMRI results taken together suggested visuospatial and visuomotor processes were sequentially arranged during the abacus mental addition with visual addends and could be dissociated from each other temporally. The visuospatial transformation of the numbers, in which the superior parietal lobule was most likely involved, might occur first (around 380 ms) after the onset of the stimuli. The visuomotor processing, in which the superior/middle frontal gyri were most likely involved, might occur later (around 440 ms). Meanwhile, fMRI results suggested that neural networks involved in the abacus mental addition with auditory stimuli were similar to those in the visual abacus mental addition. The most prominently activated brain areas in both conditions included the bilateral superior parietal lobules (BA 7) and bilateral middle frontal gyri (BA 6). These results suggest a supra-modal brain network in abacus mental addition, which may develop from normal mental calculation networks

Selective attention on representations in working memory: cognitive and neural mechanisms

Selective attention and working memory are inter-dependent core cognitive functions. It is critical to allocate attention on selected targets during the capacity-limited working memory processes to fulfill the goal-directed behavior. The trends of research on both topics are increasing exponentially in recent years, and it is considered that selective attention and working memory share similar underlying neural mechanisms. Different types of attention orientation in working memory are introduced by distinctive cues, and the means using retrospective cues are strengthened currently as it is manipulating the representation in memory, instead of the perceptual representation. The cognitive and neural mechanisms of the retro-cue effects are further reviewed, as well as the potential molecular mechanism. The frontal-parietal network that is involved in both attention and working memory is also the neural candidate for attention orientation during working memory. Neural oscillations in the gamma and alpha/beta oscillations may respectively be employed for the feedforward and feedback information transfer between the sensory cortices and the association cortices. Dopamine and serotonin systems might interact with each other subserving the communication between memory and attention. In conclusion, representations which attention shifts towards are strengthened, while representations which attention moves away from are degraded. Studies on attention orientation during working memory indicates the flexibility of the processes of working memory, and the beneficial way that overcome the limited capacity of working memory

Anodal Transcranial Direct Current Stimulation over Posterior Parietal Cortex Enhances Visuospatial Working Memory Capacity under High Memory Load

目的：探索背外侧前额叶和后顶叶对于视觉空间工作记忆的两个存储特征&mdash;&mdash;容量（记忆数量）和精度（记忆质量）的作用。 方法：使用正性经颅直流电刺激仪刺激工作记忆的两个关键脑区：左侧背外侧前额叶（lDLPFC）和右侧后顶叶（rPPC）, 刺激之后被试完成空间工作记忆连续报告任务, 记忆2个, 4个或6个线条的方向, 间隔1秒后尽可能精确地回忆其中某一位置上呈现过的线条的方向。 结果：相对于虚假刺激和前额叶刺激, 右后顶叶刺激显著地提升了记忆负荷为6时被试的空间工作记忆容量, 但降低了其记忆精度。 结论：刺激右后顶叶可以提升高记忆负荷下的空间工作记忆容量, 但是记忆的精确性会降低, 右后顶叶可能在表征空间工作记忆容量中发挥作用, 而对表征精度影响较小。</p

Age-Related Differences in the Late Positive Potential during Emotion Regulation between Adolescents and Adults

Abstract The late positive potential (LPP) has been well documented in predicting the effect of emotion regulation in previous developmental literature. However, few studies have examined age-related changes in emotion regulation from adolescence to adulthood using this biomarker. To test this, Reactivity and Regulation-Image Task was used to test 18 young adolescents and 22 adults to examine the modulation of LPP during emotion regulation. Results revealed that (a) on the behavioral level, adults reported higher intensity of emotional experience than adolescents when they were asked to use up-regulation. Down-regulation showed no age effect for self-reported rating; (b) adolescents showed higher amplitudes of LPP than adults when using different regulatory strategies in all windows; (c) In late time window, regulation effect was larger when using up-regulation strategy than down-regulation strategy for adolescents, while the difference between the two strategies was negligible for adults. (d) In early time window, reactivity effect was larger in negative conditions than in positive conditions for adolescents, while the difference between the two conditions was again negligible for adults. Differences in the amplitudes and time courses of LPP during emotion regulation between adolescents and adults suggested that age-related changes in emotion regulation may occur during adolescence

Effects of noninvasive brain stimulation on cognitive function in healthy aging and Alzheimer's disease: a systematic review and meta-analysis.

The study aimed to evaluate the effects of noninvasive brain stimulation on cognitive function in healthy older adults and patients with Alzheimer's disease. A comprehensive literature search was performed on noninvasive stimulation studies published from January 1990 to November 2014 in Pubmed and Web of Science. Fourteen articles with a total of 331 participants were identified as studies with healthy older adults, and the mean effect size and 95% confidence interval were estimated. A significant effect size of 0.42 was found for the cognitive outcome. Further subgroup analyses demonstrated more prominent effects for studies delivering the stimulation before the execution of the task and studies applying multiple sessions of stimulation. To assess the effects of stimulation on Alzheimer's disease patients, 11 studies with a total of 200 patients were included in the analysis. A significant effect size of 1.35 was found for the cognitive outcomes. Subgroup analyses indicated more pronounced effects for studies applying the stimulation during the execution of the task compared with studies delivering the stimulation before the execution of the task. Noninvasive brain stimulation has a positive effect on cognitive function in physiological and pathological aging